Win Stay { Lose Shift an Elementary Learning Rule for Normal Form Games
نویسنده
چکیده
In this paper we study a simple learning paradigm for iterated normal form games in an evolutionary context. Following the decision theoretic concept of satisscing we design players with a certain aspiration level. If their payoo is below this level, they change their current action, otherwise they repeat it. We consider stochastic generalizations of this win stay { lose shift principle that average the received payoo over several rounds of the game before comparing it to their aspiration level and allow the strategies to adapt their aspiration level in the course of the play. Our analysis is twofold. On the one hand we study the evolution of such strategies for the Prisoner's Dilemma; on the other hand we consider contexts where a randomly selected game is assigned to the players. In the presence of such high uncertainty win stay { lose shift strategies turn out to be very successful. Using computer simulations we address questions as: what is a favorable aspiration level? How many rounds should one observe before updating the current action? What is the impact of noise?
منابع مشابه
Win-stay and win-shift lever-press strategies in an appetitively reinforced task for rats
Two experiments examined acquisition of win-stay, win-shift, lose-stay, and lose-shift rules by which hungry rats could earn food reinforcement. In Experiment 1, two groups of rats were trained in a two-lever operant task that required them to follow either a win-stay/lose-shift or a win-shift/lose-stay contingency. The rates of acquisition of the individual rules within each contingency differ...
متن کاملMartin Posch WIN STAY , LOSE SHIFT OR IMITATION – ONLY THE CHOICE OF PEERS COUNTS
Win Stay, Lose Shift as well as imitation strategies for iterated games rely on an aspiration level. With both learning rules a move is repeated unless the pay-o fell short of the aspiration level. I investigate social adaptation mechanisms for the aspiration level and their impact on the eÆciency of learning in a large population of agents that repeatedly play one round of a symmetric 2 2 game...
متن کاملRetention period differentially attenuates win–shift/lose–stay relative to win–stay/lose–shift performance in the rat
Hungry rats were trained in a two-lever conditioning chamber to earn food reinforcement according to either a win-shift/lose-stay or a win-stay/lose-shift contingency. Performance on the two contingencies was similar when there was little delay between the initial, information part of the trial (i.e., win or lose) and the choice portion of the trial (i.e., stay or shift with respect to the leve...
متن کاملHybrid learning in signalling games
Lewis-Skyrms signaling games (Lewis 1969; Skyrms 2010) have been studied under a variety of low-rationality learning dynamics (Barrett 2006; Barrett and Zollman 2009; Huttegger, Skyrms, Smead, and Zollman 2010; Huttegger, Skyrms, Tarrès, and Wagner 2014; Huttegger, Skyrms, and Zollman 2014). Reinforcement dynamics are stable but slow and prone to evolving suboptimal signaling conventions. A low...
متن کاملThe limits and robustness of reinforcement learning in Lewis signalling games
Lewis signaling games are a standard model to study the emergence of language. We introduce win-stay/lose-inaction, a random process that only updates behavior on success and never deviates from what was once successful, prove that it always ends up in a state of optimal communication in all Lewis signaling games, and predict the number of interactions it needs to do so: N3 interactions for Lew...
متن کامل